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(54) Apparatus for detecting the presence of an occupant in a motor vehicle 


\ J/ ) A muiui VeriiCie uunirui system (3G) inuuaes a 
pair of cameras (26,28) for producing first and second 
images of a passenger area. A distance processor (32) 
determines distances that a plurality of features in the 
first and second images are from the cameras (26,28) 
based on the amount that each feature is shifted 
between the first and second images. An analyzer (34) 
processes the distances and determine a size of an 
object on the seat. Additional analysis of the distance 


aiso may deiermine movement oi the object and the 
rate of that movement. The distance information also 
can be used to recognize predefined patterns in the 
images and thus identify the object. A mechanism (54) 
utilizes the determined object characteristics in control- 
ling operation of a device, such as deployment of an air 
bag (58). 
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Description 

Background Of The Invention 

The present invention relates to equipment for s 
sensing the presence or absence of objects, and more 
particularly to detecting whether an occupant is present 
in a seat of a motor vehicle. 

As a safety feature, modern motor vehicles incorpo- 
rate air bags into the steering wheel in front of the driver 10 
and into the dashboard in front of a passenger in the for- 
ward seat. Additional air bags are being proposed for 
the doors to the sides of these occupants. Rapid decel- 
eration of the motor vehicle during an accident is 
detected and activates inflation of the air bags which the is 
cushion the occupants. 

Although air bags have greatly decreased the 
severity of injuries from motor vehicle collisions, they 
occasionally cause injury to the passenger or driver 
because of the rapid rate with which the air bag must be 20 
deployed. In particular, the air bag may severely injure a 
small child or infant sitting in the front seat of the vehicle. 

As a consequence, it is now recommended that 
small children and infants ride in the rear seat of the 
vehicle so as not to be exposed to the force of air bag 25 
deployment in the event of an accident. However, that 
does not address the situation which occurs when that 
recommendation is ignored and a child rides in the front 
seat of the vehicle. Furthermore, in two passenger vehi- 
cles, such as sports cars and trucks, a child or infant 30 
must be placed in a seat that faces an air bag. In this lat- 
ter situation, it has been proposed to provide a manual 
override switch which will disable the air bag in front of 
the child. However, not only must this switch be manu- 
ally operated whenever a child is present, the motor 35 
vehicle operator must remember to re-activate the air 
bag for adult passengers. 

These precautions also do not address the pres- 
ence of a relatively small adult occupant in a vehicle 
with an air bag designed to protect an larger person. 40 
Thus there is a need to be able to customize air bag 
operation in response to the size of an individual in the 
seat that is protected. 

However, in order to dynamically configure the air 
bag, its control system must be able to reliably deter- 45 
mine the occupant's size. One approach that has been 
suggested is to sense the weight of the person sitting on 
the seat. However, weight alone does not indicate the 
kinematics of a person during a crash. For example, a 
person with a low center of gravity and small upper torso so 
will have dramatically different kinematics as compared 
to a person with a small waist and muscular upper body. 
That distinction in crash kinematics is very important in 
dynamically configuring air bag operation. 

55 

Summary Of The Invention 

A general object of the present invention is to pro- 
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vide a mechanism for detecting the presence or 
absence of an occupant in a seat within a motor vehicle. 

Another object is to implement that mechanism by 
means of a stereoscopic image processing system. 

A further object is to provide such a system with the 
capability of determining the size of the seat occupant 

Yet another object of the present invention is to pro- 
vide such a system with the capability of determining 
the sitting position of an occupant. 

Another aspect of the present invention is to pro- 
vide the stereoscopic image processing system with the 
ability to detect motion in order to distinguish inanimate 
objects placed on the seat. 

A further aspect of the present invention is to pro- 
vide information for configuring the operation of an air 
bag in a motor vehicle to conform to the physical char- 
acteristics of the seat occupant. 

An additional aspect is to provide information about 
the occupant's kinematics in real time during a crash 
which would enable dynamic optimization of air bag per- 
formance. 

These and other objects are satisfied by a stereo- 
scopic object detection system which includes a pair of 
cameras that produce first and second images of the 
seat. Elements in the images are shifted in position 
between the first and second images by an amount cor- 
responding to a distance the elements are from the 
cameras. A distance processor calculates the distances 
that a plurality of features in the first and second images 
are from the pair of cameras based on the shift of the 
position of those feature between the first and second 
images. An image analyzer determines presence of an 
object on the seat from the distances. The image ana- 
lyzer also may determine the size of the object from the 
distances 

In the preferred embodiment of the stereoscopic 
object detection system, the distances are employed to 
detect movement of the object on the seat and the rate 
of that movement. Pattern recognition also can be per- 
formed on the distance information or on one of the first 
and second images to categorize the object. 

In one application of the present invention, the 
image analysis results are used by a mechanism to con- 
trol operation of a device on the motor vehicle. For 
example those results may be employed to configure 
deployment of an air bag in the motor vehicle to corre- 
spond to the physical characteristics of a person on the 
seat. 

Brief Description Of The Drawings 

Figure 1 is a side view of a motor vehicle incorpo- 
rating an occupant detection system according to 
the present invention; 

Figure 2 is a view from above the front seat of the 
motor vehicle; 

Figure 3 is a schematic block diagram of the 
present stereoscopic image processing system to 
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detect occupants in the motor vehicle seat; 
Figures 4A and 4B form a flowchart of the method 
by which the full stereoscopic images are proc- 
essed; 

Figure 5 depicts the. geometry of the trianguiation s 
method employed to determine the distance 
between the cameras and an object in the vehicle; 
Figure 6 graphically depicts distance image data 
developed by the stereoscopic image processing 
system; and io 
Figure 7 is a flowchart of the method by which pre- 
defined segments of the stereoscopic images are 
processed in real time. 

Detailed Description Of The Invention is 

With reference to Figures 1 and 2, the front portion 
of the passenger compartment of an automobile 10 
includes a dashboard 12 from which a steering wheel 
14 projects. A front seat 16 is spaced from the dash- 20 
board 12 and includes a standard headrest 18 for both 
the passenger and driver As the driver also is a vehicle 
passenger in the broad sense, the term "passenger" as 
used herein shall refer to the driver as well as other 
occupants of the vehicle. The steering wheel has a cen- 2s 
tral compartment which houses a first air bag 20 and the 
dashboard has another compartment which contains a 
second air bag 22 located in front of the right portion of 
the seat 16. 

Mounted above the windshield in the ceiling of the 30 
passenger compartment is an assembly 24 of two sep- 
arate video cameras 26 and 28 mounted side-by-side 
across the vehicle in the same plane. Each camera 26 
and 28 preferably is an imager in which each pixel loca- 
tion is randomly accessible, thereby enabling desig- 35 
nated segments of their images to be fed to an output 
without having to read out the remaining image por- 
tions. Imagers of this type are referred to as an "active 
pixel sensor" (APS) and are described in U.S. Patent 
No. 5,471,515, the description of which is incorporated 40 
herein by reference. Alternatively other types of imag- 
ers, such as charged coupled devices (CCD), could be 
employed with the sacrifice of the ability to randomly 
access image segments. Preferably the cameras 26 
and 28 are responsive to near infra-red light and one or 45 
more sources 29 of infra-red light are mounted above 
the windshield to illuminate the front seat 1 6 of the vehi- 
cle. Such illumination allows operation of the present 
system at night without affecting an occupant's ability to 
see the highway. In addition the illumination from source so 
29 fills in image shadows during daytime operation. 

The left camera 28 has a horizontal viewing area 
indicated by the long dash lines in Figure 2, whereas the 
right camera 26 has a horizontal viewing area indicated 
by the long and short dashed lines. The vertical viewing 55 
angles of each camera 26 and 28 are the same as indi- 
cated by the dashed lines in Figure 1 . The left and right 
cameras 26 and 28 produce a first and second pair of 
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stereoscopic images of the front seat 16 of the motor 
vehicle, as well as the body of occupant locations on 
that seat. Because the two cameras 26 and 28 are off- 
set left to right across the vehicle, the first and second 
images, which are acquired substantially simultane- 
ously, will contain essentially the same objects, but the 
objects will be shifted horizontally between the two 
images. This produces a stereoscopic pair of images 
which can be analyzed to determine distances from the 
cameras to objects in the vehicle. As will be described, 
that analysis employs well known photogrammetry tech- 
niques such as those used to measure height of geo- 
graphic features in aerial photographs. Alternatively, a 
single imaging device may be used with two sets of lens 
and mirror to focus a stereoscopic pair of images side- 
by side into the same imaging device. This alternative is 
considered to be equivalent to employing a separate 
camera for each stereoscopic image. 

Although the left and right halves of the stereo- 
scopic images are processed to determine the pres- 
ence, positions and sizes of two passengers on seat 16, 
for ease of explanation the processing of only half of the 
image will be described with the understanding that 
both halves are processed in the same manner. 

With reference to Figure 3, the images from the 
right and left cameras 26 and 28 are applied to the 
inputs of an image processor 30. The image processor 
30 comprises a distance subprocessor 32 which deter- 
mines the distance that objects in the images are from 
the camera assembly 24, and a distance picture 
processing system 34 which analyzes the distance 
measurements to determine the presence, size and 
other characteristics of an occupant on the motor vehi- 
cle seat 16. 

The distance subprocessor 32 comprises a dis- 
tance detector 36 which locates the same feature in 
each stereoscopic image and calculates the distance to 
that feature. That distance measurement is stored 
within memory 38 as an element of a distance picture. 
The distance subprocessor 32 is similar to one 
described in U.S. Patent No. 5,530,420, the description 
of which is incorporated herein by reference. 

The distance picture memory 38 is accessible by 
both the distance detector 36 and by the distance pic- 
ture processing system 34 via a memory interface 40. 
The memory interface 40 is connected to a set of data, 
address and control buses 42 which also connect to a 
microprocessor 44. The microprocessor executes a pro- 
gram that is stored within a read-only memory 46 which 
analyzes the distance picture data, as will be described. 
A random access memory (RAM) 48 is connected to the 
buses 42 to store intermediate results and other data 
utilized by the microprocessor 44 during that analysis. 
The microprocessor 44 also may acquire a visual image 
directly from the right video camera 26 via a camera 
interface 49 connected to buses 42. An output memory 
50 is provided to hold the results of the distance picture 
analysis and an interface circuit 52 communicates those 


3 


EP 0 885 782 A1 


results to devices outside the distance picture process- 
ing system 34. In the case where the present system 
governs the operation of an air bag within the motor 
vehicle, the interface circuit 52 is connected to inputs of 
an air bag controller 54. That controller 54 also receives s 
an indication from a collision sensor 56 when an acci- 
dent is occurring. The collision sensor 56 may provide 
an indication of the severity of the crash, e.g. rate of 
deceleration. The air bag controller 54 responds to 
these inputs by activating the driver and passenger air 10 
bags 58. 

The stereoscopic images are processed on a timed 
interrupt basis, for example every ten seconds the entire 
stereoscopic image is analyzed, while only selected 
portions of the two images are processed every miili- is 
second. The full image processing commences at step 
70 in the flow chart of Figure 4A with periodic acquisi- 
tion of the two stereoscopic images from the right and 
left video cameras 26 and 28. At that time the micro- 
processor 44 receives an interrupt signal and responds 20 
by issuing a full image acquisition command to the dis- 
tance detector 36. Then at step 72, the distance detec- 
tor 36 analyzes the acquired stereoscopic images to 
find a small group of picture elements in one image that 
match a group of picture elements in the other image, 2s 
thus locating coinciding points on objects in each 
image. Such coinciding points may be object features 
such as edges, lines, and specific shapes. 

The distance detector 36 upon locating the corre- 
sponding point in both images, utilizes photogrammetric 30 
triangulation in determining the distance that such a 
point on an object in the images is the plane of the cam- 
era lens. That process is well known, see Paul R. Wolf 
in Elements of Photogrammetry, 1974, McGraw-Hill, 
Inc. As shown in Figure 5, the left and right cameras are 35 
spaced a distance r apart in the plane of the camera 
lens and each camera has focal points a distance f 
behind the camera lens plane. Because of the left to 
right offset distance r between the two cameras, a dis- 
crepancy amount x will exist between the same point in 40 
each camera image. Therefore the distance D between 
the camera lens plane and the image point can be 
determined from the expression: D = r(f/x) . The values 
for r and f are known from the design of the camera 
assembly 24. 45 

The discrepancy amount x between the right and 
left images is determined at step 74 based on the differ- 
ence in pixel locations of the coinciding point in the two 
images and the width of each pixel. By inserting this 
value of x into the above expression, the distance detec- so 
tor 36 at step 76 computes the distance value D which 
is stored in memory 38 at step 78 as one of many ele- 
ments of a distance picture. As will be described the dis- 
tance picture memory 38 is capable of storing two 
distance pictures with data for a new set of stereoscopic ss 
images replacing the older distance picture. Thus the 
two most recently derived distance pictures always will 
be retained in the memory 38. 


Then, a determination is made at step 80 whether 
more coinciding points have to be located and proc- 
essed in the stereoscopic images When all of the coin- 
ciding image points have been processed, the distance 
picture is a two dimensional array of data with each 
location in the array containing the distance for the cor- 
respondingly located point in the stereoscopic images. 
Thus, the data within the distance picture could be plot- 
ted graphically as a relief map of the image in terms of 
distance from the camera lens plane. An example of 
such a three dimensional plot is shown -in Figure 6 
where x and y axes correspond to the pixel locations 
within the camera image and the z axis corresponds to 
the magnitude of the distance data for each pixel loca- 
tion. At the outer edges of the distance picture, the data 
is relatively flat corresponding to the surface of the seat 
16, whereas the central portion of the image corre- 
sponds to an object which is placed on the seat. In point 
of fact, the distance values corresponding to the seat 
will be larger than those corresponding to the object as 
the vehicle seat 16 is farther from the camera. Never- 
theless, it should be noted that the edges of the object 
are denoted by abrupt, large transitions in the distance 
data. This enables the outer boundaries of the object to 
be found. As will be described, the volume of an object 
in the image can be derived by determining the average 
x and y dimensions between the object boundaries and 
the average distance valve. 

Referring again to the flowchart of Figure 4A, to 
analyze the distance picture, the microprocessor 44 at 
step 82 scans the distance picture to determine the dif- 
ference between the data values corresponding to the 
seat 16 and the image portion which is closest to the 
camera. When the difference between the distance to 
the seat 16 and the distance to other image features 
exceeds a threshold amount, the microprocessor 44 
concludes that an object is present on the seat 16. In 
order to avoid erroneous conclusions as may be pro- 
duced by one or two spurious data points denoting a 
very close location to the camera, the microprocessor 
may require that there be a relatively significant number 
of points at which the distance exceeds that threshold in 
order to conclude that an object is present on the seat 
16. That determination is made at step 84 in the image 
analysis and if true a flag is set in output memory 50. If 
it is concluded that a significant object is not present, 
the output memory 50 is cleared at step 83 and further 
analysis of the distance image terminates. 

When the microprocessor 44 concludes that the 
data indicates a person may be present, the distance 
picture is analyzed further at step 85 to find the average 
distance between the camera and the person. The 
result of that calculation is stored within the output 
memory 50. Next, at step 86, the distance picture in 
memory 38 is analyzed to approximate the volume of 
the person in the seat 16. In doing so, the microproces- 
sor 44 looks for the horizontal and vertical boundaries of 
the person which are indicated by relatively large transi- 
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tions in the distance data as seen in Figure 6. This pro- 
vides a contour of the outer boundary of the person and 
standard techniques can be utilized to calculate the 
area within that boundary. Next the previously calcu- 
lated average distance between the seat 16 and the 
object is used as the third dimension of the person in the 
volume calculation. The result is stored in output mem- 
ory 50. 

At step 87 the left to right position of the person is 
found by determining the location of the volume with 
respect to the border of the image. It is useful to know 
how close a passenger is to the door in order to control 
the deployment of a side air bag. A further inspection 
can be made to determine the position of the volume 
with respect to the lower border of the image which indi- 
cates whether a large passenger has slid down in the 
seat. The position information also is stored in output 
memory 50. 

Then, at step 89, an analysis is performed on the 
distance picture to find key physical features, such as 
the top of the person's head. This can be determined by 
looking for a relatively large transition in the data pro- 
ceeding downward from the top of the distance picture. 
This location of the top of the head indicates the relative 
height of the passenger. The results of all these analy- 
ses at steps 85-88 are stored within the output memory 
50 of the distance picture processing system 34. 

In many applications the image processing 
described thus far provides sufficient information for 
controlling a device, such as an air bag, on a motor vehi- 
cle. However, the image data may be analyzed further 
to provide additional information about the vehicle occu- 
pants. Subsequent processing can determine whether 
an object in the seat 16 is moving and thus distinguish 
between a large inanimate object and a person. To this 
end, the analysis by distance picture processing system 
34 progresses to step 90 on Figure 4B. 

At this time the new distance picture in memory 38 
is compared to the previous distance picture which also 
is stored in that memory. If motion has not occurred at 
one of the sitting positions in the vehicle seat 16 during 
the ten second image acquisition period, then a deter- 
mination can be made that objects in the image are 
inanimate. This is accomplished at step 92 by compar- 
ing the two distance pictures, data element by data ele- 
ment, and counting the number of pairs of data 
elements that differ by more that a predefined amount. 
Alternatively, the two temporally different video images 
from either the right or left camera 26 or 28 can be com- 
pared to detect motion of an object. A slight variation is 
expected between two distance images derived at dif- 
ferent points in time, even when only inanimate objects 
are present, because of movement due to vehicle vibra- 
tion. Thus in determining motion, a negligible change in 
a given data point in the distance image will not be con- 
sidered and a significant change of only a few data 
points also will be ignored. However a significant 
change of a substantial number of distance data points 


indicates movement of the object on the vehicle seat 1 6. 
The exact amount of change between the value of a 
given data point and the number of data points which 
must have such a change in order to be considered as 

s indicating movement are functions of the response of 
the video cameras and the image resolution. 

After comparing the two distance images, a deter- 
mination is made at step 94 whether substantial number 
M of data points have changed by the requisite amount. 

10 In that case a movement flag in the output memory 50 is 
set at step 96 to indicate that the object at that sitting 
position has moved. Otherwise that movement flag is 
reset at step 98. 

If. desired, the image processing may continue by 

15 performing pattern recognition using any one of several 
welt known pattern recognition techniques. For this pur- 
pose, the image processor 30 stores a reference, or 
master, pattern in random access memory 48. For 
example the reference pattern may be for an empty seat 

20 or an infant seat placed on the vehicle seat 16. The ref- 
erence pattern is generated at step 1 00 by producing a 
distance picture of the reference stereoscopic images 
and processing that distance picture to derive the pat- 
tern data. For example the distance picture is proc- 

25 essed to obtain object edge information which then is 
stored in random access memory 48 at step 103 by the 
program execution branching there from step 102. 

Thereafter during image processing at step 100, 
similar pattern data is derived from a new set of stereo- 

30 scopic images. That pattern data is compared at step 
104 to the reference pattern. A determination is made 
by the microprocessor 44 at step 106 whether there is a 
substantial correspondence between the new image 
pattern and the reference pattern in which case an indi- 

35 cator flag is set in the output memory 50 at step 106. 
Otherwise that pattern match flag is reset at step 1 1,0. 
Alternatively the visual images directly from the right 
camera 26 can be acquired via camera interface 49 and 
processed for pattern recognition. 

40 Processing of the entire distance image then termi- 
nates at which point the output memory 50 of the image 
processor 30 contains the results of the various analy- 
ses performed. The air bag controller 54 is able to 
obtain those stored results via the interface circuit 52 

45 and evaluate the results in determining how to deploy 
the air bags 58 in the event of an accident. The periodic, 
e.g., once every ten seconds, analysis of the entire ster- 
eoscopic image thus enables continuing update of the 
operating parameters for the air bags. Such periodic 

so review of the occupancy situation of the seat accounts 
for changes in the sitting position and other movement 
of the individual within the vehicle cabin. 

When the image processor 30 results indicate that 
a person was not present within the seat 16, the air bag 

55 need not be deployed as such would serve no purpose. 
Furthermore, if the analysis by microprocessor 44 indi- 
cates that a person occupying the vehicle seat 16 has a 
relatively small volume and/or was relatively short as 
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determined by the location of the top of that person's 
head, it is likely that the seat occupant is a child. In 
those cases, the air bag controller 54 would disable 
deployment of the air bag. 

In a situation where the microprocessor 44 con- s 
eluded that a sufficiently large person is present, the ini- 
tial rate at which the air bag is inflated during an 
accident would be set to correspond to the occupant's 
volume, height and average distance to the air bag. 
Specifically, the closer the person is to the air bag and 10 
the larger the person, the faster the rate of deployment. 

During the crash the kinematic information about 
the person's movement is useful to regulate the rate of 
air bag inflation to correspond to the severity of the acci- 
dent. The faster the crash and the greater the forces 75 
acting on the occupant, the faster an air bag should 
inflate. The present image processing system also can 
provide kinematic information about the occupant with- 
out additional hardware. 

Therefore, present system processes selected seg- 20 
ments of the stereoscopic images more frequently, than 
processing the entire images, to provide real time infor- 
mation as to how the occupant is moving during a crash. 
To this purpose, the microprocessor 44 also executes a 
interrupt routine depicted in Figure 7 every millisecond, 25 
for example. This interrupt routine commences at step 
120 with the microprocessor 44 sending a command to 
the distance subprocessor 32 via memory interface 40 
which instructs the distance detector 36 to acquire and 
process a predefined portion of the stereoscopic 30 
images from video cameras 26 and 28. The predefined 
portion of each image may comprise two segments of 
ten columns of picture elements within each image 
which correspond to the center of the normal sitting 
positions for the seat occupants. These segments then 35 
are processed to determine parameters for controlling 
the air bag associated with those two sitting positions. 
For simplicity only the processing of the image seg- 
ments for one of those sitting positions will be 
described. 40 

The distance detector 36 at step 122 locates coin- 
ciding points or features in the image segments from 
each camera in the same manner as was performed 
with respect to the entire image described previously. 
Then the discrepancy amount x between the coinciding 45 
points in the stereoscopic image segments is deter- 
mined at step 124 and used at step 126 to calculate dis- 
tance data for the image segment. That distance data is 
stored in a section of the distance picture memory 38 at 
step 128. The distance picture memory 38 has two sec- so 
tions of additional storage locates in which distance 
data for image segments are stored. One section stores 
data for the most recent set of image segments and the 
other section contains previous image segment dis- 
tance data with each new group of data overwriting the 55 
memory section containing the oldest distance data. 

The microprocessor 44 in the distance picture 
processing system 34 then takes over by computing the 
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change in distance between the two stored sets of dis- 
tance data at step 130. The change information is 
stored in the output memory 50 at step 132. Because 
the distance data is acquired at regular intervals, e.g. 
every millisecond, the changes correspond directly to a 
rate of change in distance or in other words the speed at 
which the object on the seat is moving. The speed can 
be calculated and stored in the output memory 50 or the 
air bag controller 54 may simply use the distance 
change data directly. In either case this data in the out- 
put memory corresponds to the object speed. 

The speed related data is made available to the air 
bag controller 54 via the interface circuit 52. The air bag 
controller 54 regulates the rate at which the air bags 58 
inflate in response to the speed at which a vehicle occu- 
pant is approaching the respective air bag during an 
accident 

Claims 

1 . A stereoscopic object detection system for sensing 
and categorizing objects present on a seat (16) of a 
motor vehicle (10), the stereoscopic object detec- 
tion system comprising: 

a camera assembly (24) for producing first and 
second images of the seat in which image fea- 
tures are shifted between the first and second 
images by an amount corresponding to dis- 
tances the image features are from the camera 
assembly (24); 

a first image analyzer (34) coupled to the cam- 
era assembly (24) and processing the first and 
second images to determine presence of an 
object on the seat (1 6) ; and 
an output device (52) coupled to the first image 
analyzer (34) and producing a signal in an 
event that the presence of an object on the seat 
(16) is detected. 

2. The stereoscopic object detection system as 
recited in claim 1 wherein the camera assembly 
(24) comprise an image sensor (26,28) in which 
segments of the first and second images are ran- 
domly accessible. 

3. The stereoscopic object detection system as 
recited in claim 1 further comprising a second 
image analyzer (34) which processes the first and 
second images to determine a size of the object on 
the seat (1 6) in response to a given amount that the 
object is shifted between the first and second 
images; and the signal indicates the size of the 
object on the seat. 

4. The stereoscopic object detection system as 
recited in claim 1 further comprising a processor 
(32) connected to the camera assembly (24) and 
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which determines distances that a plurality of fea- 
tures in the first and second images are from the 
camera assembly (24), wherein the distances are 
determined in response to a given amount that the 
plurality of features are shifted between the first and 5 
second images. 

5. The stereoscopic object detection system as 
recited in claim 4 wherein the first image analyzer 
(34) employs the distances in determining the pres- 10 
ence of an object on the seat. 



a camera (26,28) for producing an image of a 
seat (16) in the vehicle; 

an image analyzer (34) coupled to the camera 
(26,28) and processing the image to determine 
a physical characteristic of an object on the 
seat (16); and 

a mechanism (54) coupled to image analyzer 
which controls deployment of an air bag (58) in 
response to the physical characteristic. 


6. The stereoscopic object detection system as 
recited in claim 4 wherein the second image ana- 
lyzer (34) employs the distances in determining the 15 
size of the object on the seat. 

7. The stereoscopic object detection system as 
recited in claim 1 further comprising a second 
image analyzer (34) which employs information 20 
from the camera assembly (24) to detect movement 

of an object on the seat (16). 

8. The stereoscopic object detection system as 
recited in claim 1 further comprising a pattern 25 
detector (100-106) which receives information from 
the camera assembly (24) and processes the infor- 
mation to recognize presence of a predefined pat- 
tern in at least one of the first and second images. 

30 

9. The stereoscopic object detection system as 
recited in claim 8 wherein the pattern detector (1 00- 
1 06) comprises a memory (48) for storing a refer- 
ence pattern; and a processor (34, 104) which 
detects presence of the reference pattern in the 35 
information from the camera assembly (24). 

10. The stereoscopic object detection system as 
recited in claim 8 wherein the reference pattern is 

for a child seat. 40 

11. The stereoscopic object detection system as 
recited in claim 8 wherein the reference pattern 
denotes a physical characteristic of a motor vehicle 
operator. 45 

12. The stereoscopic object detection system as 
recited in claim 1 further comprising a mechanism 
(54) connected to the output device and controlling 
deployment of an air bag (58) in response to the 50 
signal. 

13. The stereoscopic object detection system as 
recited in claim 8 the camera assembly (24) com- 
prises a pair of cameras (26,28). 55 

14. A system for controlling operation of an air bag in a 
vehicle, said system comprising: 


15. A stereoscopic object detection system for sensing 
and categorizing objects present on a seat of a 
motor vehicle (10), the stereoscopic object detec- 
tion system comprising: 

a pair of cameras (26,28) for producing first 
and second images of the seat and objects 
thereon, in which image features are shifted 
between the first and second images by an 
amount corresponding to distances the image 
features are from the pair of cameras; 

a distance processor (32) connected to the pair 
of cameras (26,28) for determining distances 
that a plurality of features in the first and sec- 
ond images are from the pair of cameras, 
wherein the distances are .determined in 
response to a given amount that each feature is 
shifted between the first and second images; 

an analyzer (34) coupled to the distance proc- 
essor to analyze the distances and determine a 
size of an object on the seat; and 

a mechanism (54) for controlling operation of a 
device (58) of the motor vehicle in response to 
the analyzer (34). 

16. The stereoscopic object detection system as 
recited in claim 15 further comprising another ana- 
lyzer (34) employs the distances in determining 
whether an object is present on the seat. 

17. The stereoscopic object detection system as 
recited in claim 15 further comprising another ana- 
lyzer (34) which employs the distances in detecting 
movement of the object. 

18. The stereoscopic object detection system as 
recited in claim 15 further comprising another ana- 
lyzer (34) which employs the distances in detecting 
a rate of movement of the object. 

19. The stereoscopic object detection system .as 
recited in claim 15 further comprising a pattern 
detector (100-104) which receives information from 
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at least one of the pair of cameras (26,28) to recog- 
nize presence of a predefined pattern in at least 
one of the first and second images. 

The stereoscopic object detection system as 
recited in claim 15 wherein the mechanism (54) 
controls deployment of an air bag (58). 


21 . A method for controlling operation of an air bag (58) 
in an vehicle (10), said method comprising step of: 

acquiring an image of a passenger area of the 
vehicle; 


person in the passenger area; and the step of con- 
trolling operation of the air bag is further in 
response to whether movement of the person is 
detected. 

s 

30. The method as recited in claim 21 further compris- 
ing processing the image to produce information 
regarding a rate of movement of the person in the 
passenger area; and the step of controlling opera- 
te tion of the air bag is further in response to the rate 
of movement. 


processing the image to determine a size of a 
person in the passenger area; and 

controlling operation of the air bag (58) in 
response to the size of the person in the pas- 
senger area. 

22. The method as recited in claim 21 wherein the step 
of acquiring an image comprises acquiring a pair of 
stereoscopic images which have features that are 
shifted between each stereoscopic image by 
amounts corresponding to distances that the fea- 
tures are from a reference point. 


15 


20 


25 


23. The method as recited in claim 21 wherein the step 
of processing the image determines distances that 
features in the image are from a reference point. 


30 


24. The method as recited in claim 22 wherein the step 
of processing the image employs the distances to 
determine the size of the person. 35 

25. The method as recited in claim 23 wherein the step 
of processing the image employs the distances to 
approximate the volume of at least a portion of the 
person. 40 


26. The method as recited in claim 23 wherein the step 
of processing the image employs the distances to 
approximate the height of the person. 

27. The method as recited in claim 23 wherein the step 
of processing the image employs the distances to 
determine a position of the person within the pas- 
senger area. 

28. The method as recited in claim 21 further compris- 
ing processing the image to produce kinematic 
information about the person in the passenger 
area; and controlling operation of the air bag also is 
in response to the kinematic information. 


45 


so 


55 


29. The method as recited in claim 21 further compris- 
ing processing the image to detect movement of the 
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